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CJ ■ Abstract 

o 

^ . We consider the general response theory recently proposed by Ruelle for describing the impact 

of small perturbations to the non-equilibrium steady states resulting from Axiom A dynamical 
CJ ' systems. We show that the causality of the response functions entails the possibility of writing a 

^ ! 

^ ' set of Kramers-Kronig relations for the corresponding susceptibilities at all orders of nonlinearity. 

. Nonetheless, only a special class of directly observable susceptibilities obey Kramers-Kronig rela- 

->-> . 
c/2 . 

tions. The apparent contradiction with the principle of causality is also clarified. Specific results 
are provided for the case of arbitrary order harmonic response, which allows for a very compre- 



■ hensive Kramers-Kronig analysis and the establishment of sum rules connecting the asymptotic 

O . behavior of the harmonic generation susceptibility to the short-time response of the perturbed 



system. These results set in a more general theoretical framework previous findings obtained for 



^ ■ optical Hamiltonian systems and simple mechanical models, and shed light on the very general im- 

oo : 

lO . pact of considering the principle of causality for testing self-consistency: the described dispersion 

^ , 

I relations constitute unavoidable benchmarks that any experimental and model generated dataset 

O ' 

must obey. In order to gain a more complete picture, connecting the response theory for equi- 
. librium and non equilibrium systems, we show how to rewrite the classical response theory by 

- ^ , Kubo for systems close to equilibrium so that response functions formally identical to those pro- 

?H ' posed by Ruelle, apart from the measure involved in the phase space integration, are obtained. 

Finally, we briefly discuss how the presented results, taking into account the chaotic hypothesis 
by Gallavotti and Cohen, might have relevant implications for climate research. In particular, 
whereas the fluctuation-dissipation theorem does not work for non-equilibrium systems, because 
of the non-equivalence between internal and external fluctuations, Kramers-Kronig relations might 
be more robust tools for the definition of a self-consistent theory of climate change. 

PACS numbers: 05.20.-y, 05.30.-d, 05.45.-a, 05.70.Ln 
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I. INTRODUCTION 



The analysis of how systems respond to external perturbations to their steady state 
constitutes one of the crucial subjects of investigation in the physical and mathematical 
sciences. In the case of physical systems near equil.bdnm. the powerful approach introduced 

by Kubo pj], based on the generalization up to any order of nonlinearity of the formalism of 
the Green function, allows for expressing the change in the statistical properties of a general 
observable due to the introduction of a perturbation in terms of expectation values of suitably 
defined quantities evaluated at the unperturbed state These results have had huge impact 
on statistical mechanics and have allowed detailed treatment of several and rather diverse 
processes, including, e.g. the interaction of radiation with condensed matter. Recently, 
Ruelle j^, 4] has extended some of the investigations by Kubo to a wide class of systems 
far from equilibrium, and introduced a perturbative approach for computing the response 
of systems driven away by a small external forcing from their non-equilibrium steady states. 
More precisely, the results by Ruelle consider perturbations to autonomous Axiom-A flows 
(and maps) defined in a compact manifold, which possess a chaotic, mixing dynamics, and 
are associated to an invariant ergodic Sinai- Ruelle-Bown (SRB) measure 5|, ISj. We remind 
that, the - mathematically speaking, special - case of Axiom A systems amounts to being 
of general physical interest, if one accepts the chaotic hypothesis by Gallavotti and Cohen 







8| which states that, for the purpose of computing macroscopic quantities, many-particle 
systems behave as though they were dynamical systems with transitive Axiom-A global 
attractors. Ruelle shows that, in analogy to what found by Kubo, at all orders of perturbative 
expansion, the effect of the forcing on the expectation value of a general observable can be 
expressed in terms of averages of quantities performed at the non-equilibrium steady state, 
i.e. obtained by integrating over the unperturbed SRB measure. Moreover, in the case of 
linear response, it is shown that it is possible to define formally a susceptibility function, 
obtained as the Fourier Transform of the linear Green function of the system, and to prove 
that such susceptibility, basically as a result of the causality principle, obeys Kramers- 
Kronig (K-K) relations [o], [l^, just as in Kubo framework. The K-K relations say that 
the the real and imaginary part of the linear susceptibility are fundamentally connected, 
each one being the Hilbert transform of the other one. Hence, these integral properties 
provide unavoidable constraints for checking the self-consistency of experimental or model- 
generated data. Furthermore, by applying the K-K relations, it is possible to perform the 
so-called inversion of data, i.e. to acquire knowledge on the real part by measurements of 
the imaginary part over the whole spectrum or vice versa. 



Nevertheless, in spite of such important formal analogies, it is important to stress some 
qualitative differences between equilibrium and non-equilibrium systems in the physical 
meaning of the linear response function. Whereas in systems close to equilibrium there 
is basically equivalence between the natural fluctuations and the linear response to external 
perturbations, as clarified by the fluctuation-dissipation theorem [3], in the considered 
non equilibrium systems such symmetry in broken, the mathematical reason being that the 
SRB measure is smooth only along the unstable manifold. A more geometrical view of this 
fact is that, whereas natural fluctuations of the system are restricted to the unstable mani- 
fold, because, by definition, asymptotically there is no dynamics along the stable manifold, 
external forcings will cause almost always motions having components - of exponentially 
deca ying amplitude - out of the unstable manifold 4|. For a discussion of this point, see 



also [2j]. It should also be noted that the non-equivalence of forced and free fluctuations in 
chaotic systems was already pointed out and tackled in heuristic terms in the late '70s by 
Lorenz 13|] when considering the atmospheric system. 

Whereas K-K relations for linear processes, thanks to their generality, have become a 
basic textbook subject and standard tool in many different fields, such as acoustics, signal 
processing, optics, statistical mechanics, condensed matter physics, material science, rela- 
tively little attention has been paid to theoretical and experimental investigation of K-K 
relations and sum rules of the nonlinear susceptibilities, in spite of the ever increasing scien- 
tific and technological relevance of nonlinear physical processes. Recently, several theoretical 
and experimental results in this direction have been formulated in the context of analyzing 
nonlinear processes of interaction of radiation with matter isl ]. 

The main goal of this paper is to analyze the formal properties on the n^^ order pertur- 
bative response of Axiom A, non equilibrium steady state systems to external forcings. In 
particular, we develop a theory of generalized K-K relations that extend, on one side, the 
results on the linear case given by Ruelle 3l for this class of systems, and on the other side, 

nn 

what obtained for nonlinear processes in electronic systems close to equilibrium p^, 115| and 
in simple yet prototypical mechanical systems [3]. Special attention is paid to the case 
of nonlinear susceptibilities describing processes responsible for harmonic generation, whose 
properties are such that a rather extensive set of important properties - including sum rules 
- can be deduced. We stress that also in the nonlinear case K-K relations constitute un- 
avoidable benchmarks that any experimental and model generated dataset must obey. K-K 
relations may prove, as discussed later, useful tools for defining a theory of climate change, 
because they apply also for systems where the fluctuation-dissipation theorem is not verified. 

Our nanPT is striir.tiirpd a.s fnllnws Tn Spp. [TTI wp, intrndiir.p, thp nrnnp.rtips nf thp P"pn- 



eral n susceptibility, resulting as Fourier transform of the n perturbative order response 
function of the system. In Sec. Illlt we present an extension of the theory of nonlinear K-K 
relations to the dynamical systems considered by Ruelle, showing which class of nonlinear 
susceptibilities obey K-K relations and deducing rigorous results in the case of harmonic 
generation processes. In Sec. IIVI we discuss our results, present our conclusions and per- 
spectives for future investigations. Two appendices are also included. In App. |A]we show 
how the Kubo theory can be formally reconciled with the results by Ruelle, so that the 
results presented in this work can be applied also for general equilibrium systems. A discus- 
sion of the relevance for climate studies of the response theory for Axiom-A systems and of 
the specific results described in this study is given in App. |Bl 



II. LINEAR AND NONLINEAR RESPONSE OF PERTURBED NON- 
EQUILIBRIUM STEADY STATES 

We consider an autonomous Axiom-A flow x = F{x) defined in a compact manifold, 
such that x{t) = f^x, with x = x{0). The flow is assumed to possess a chaotic, mixing 
dynamic, and to be associated to an invariant ergodic SRB measure psRsidx), such that for 
any measurable observable the ensemble average is equal to the time average: 

($)o = / PsRBidxMx) = hm i [ dt$(/*x) = hm [ dx<!>{fx) (1) 

J T^oo I J T^oo J 



for almost every initial condition x according to the Lebesgue measure dx; the last equality 
holds for the special case of mixing dynamics. The SRB measure is usually singular, but 



smooth along the directions of the unstable manifold 



3, y, Q- 



Ruelle has shown that 



for this specific class of dynamical systems (as well as for the corres pon ding discrete-time 
diffeomorphisms) it is possible to differentiate the SRB states {20!. 121 1 when the flow is 
perturbed by an infinitesimal vector field in the following way: 

x = F{x) + e{t)X{x). (2) 

Is is then possible to express the perturbed expectation value of ^{x) in terms of a pertur- 
bation series: 

00 

($)(t) = ($)o + E(*)^"^W (3) 

n=l 



where, proposing a slight generahzation of the formula proposed by Ruelle [J], which consid- 
ered purely periodic perturbations, the n*^ term can be expressed as a n-uple convolution 
integral of the n*^ order Green function with n terms each representing the suitably delayed 
time modulation of the perturbative vector field: 



oo oo oo 

($)W(t)= j j ... j daAcT2...danG^^\a^,...,an)e{t-aMt-^2)...e{t-an). (4) 



The n*^ order Green function is causal, i.e. its value is zero if any of the argument is 
non positive, and can be expressed as time dependent expectation value of an observable 
evaluated over the unperturbed SRB measure: 

G(")((Ti, . . . = j psRsidx) e((Ti)e((T2 - (Ti) . . . e(a„ - x 

xAn(a„ - (T„_i) . . . An((T2 - (Ti)An((Ti)$(x), (5) 

where 6 is the usual Heaviside function, A(«) = X(x)V(») describes the effect of the 
perturbative vector field, and 11 induces the time evolution along the unperturbed vector 
field so that II{t)A{x) = A{x{t)) for any observable A. The n = 1 term describes the 
linear response of the system to the perturbation field j^, and, thanks to the superposition 



principle, can be derived also by using the method of impulse perturbation [2^. In App. 
IX] we show that it is possible to rephrase the Kubo response theory [l| in such a way to 
obtain a formula that perfectly matches the formula presented in Eq. ([5]), provided that the 
equilibrium canonical distribution is used instead of the SRB measure psRsidx). 

A. Response of the system in the frequency domain 

If we compute the Fourier transform of the ra*'* order perturbation to the expectation 
value defined in Eq. (jl]) we obtain: 



oo oo 



($)(")H = j ... j d^i...d^„x^")(a;i,...,a;„)e(wi)---eK)x5|^^-^^;l, (6) 



-oo — oo 



where the Dirac 6 guarantees that the sum of the arguments of the Fourier transforms of the 
time modulation functions equals the argument of the Fourier transform of whereas 



the susceptibility function is defined as 



oo oo 



(o;i,...,a;„)= J ... J dti...dt„G(") (ti,...,t„) 



exp 



-oo — oo 



(7) 



These operations make sense if the Green function is inteerrable or at least, in a weaker, 

n n 

distributional sense, if it not exponentially increasing. In the linear case, Ruelle [3|, IJj 
has shown that integrability is ensured by proving that both the contributions associated 
to terms resulting from projections of the perturbative vector field on the unstable and 
stable manifolds converge, because of the distinct processes of mixing and of exponential 
contraction, respectively. In the nonlinear n > 1 case, we can heuristically use the same 
arguments - as well as taking into account that in the classical equilibrium case [l| the 
higher order correlations are typically much weaker and with faster decrease - to exclude 
the possibility that the operation presented in Eq. ([71) is meaningless. 

Assuming that, without serious loss of generality, the function e{t) can be expressed as: 



e(t) = ^ e^^ exp[-icjjt] + e-^. exp[icujt] (8) 

k=l 

with e^^ = [e_^J*, we derive that each frequency component in Eq. [6] can be written as: 

($) W(^) = wf^ M s - , (9) 

where we are summing over all the possible distinct values {cj-'e} of the possible sums of n 
among the 2m frequencies in the spectrum of e(t), which basically formalizes the process of 
frequency mixing. Of course, in the linear n = 1 case, no mixing occurs and outputs can be 

-in) 



observed at the same frequencies as the input. In general, each term ($) (cus) is given by 
the following sum: 

M^"^^s)= E x("U^..,...,^feJe.,^...e.,„, (10) 
where the sum of the arguments of all the contributing susceptibility functions is ujy.. Note 



that, from an experimental point of view, we can measure ($) {^t) by analyzing in the 
frequency domain the perturbed output of the system, whereas disentangling the various 
terms contributing to the summation in Eq. ffTOl) is rather hard. Again, this problem is not 
present in the linear case. 



III. GENERALIZED KRAMERS-KRONIG RELATIONS 



A. Basic Results 

Once we are granted that at every order n the response on the system is written 

as a convolution integral having as Kernel a causal Green function G'*-"''((Ti, . . . , cr„), and 
assuming that the suitable integrability conditions are obeyed, we are in the conditions of 
writing generalized dispersion relations for the n^^ order susceptibility presented in Eq. ([7j), 
along the lines of what developed in the context of optics in [isl. Therefore, we can 



apply Titchmarsch's theorem 



10 



14 



15j separately to each variable of G^'^\ai, . . . , cr„) 
and deduce that x''"^ (i^i, • • • , ^n) is holomorphic in the upper complex plane of each variable 
uji, 1 < i < n. If we consider the first argument uoi of the nonlinear susceptibility function 
([7]), the following dispersion relation holds 

dcJi = i7rx(wi,...,w„), (11) 

—oo 

where P indicates that integration is performed in principal part. Repeating the same 
procedure for all the remaining n — 1 frequency variables, we obtain 

oo oo ^ ^ 

P / / d^-.-.d..- x^-K,---,^;) (12) 

J J [u[-UJi)...[uj'^-UJn) 

— oo — oo 

which extends to all orders the linear K-K relations already described by Ruelle jsl. K-K 
relations constitute self-consistency constraints that must be obeyed and allow to reconstruct 
the real part of the response from the imaginary part, or vice- versa. The principle of causality 
of the response function is reflected mathematically in the validity of the K-K relations 
presented in Eq. f fT2|) . Note that, as discussed by Peiponen [igI, [i7|, all the functions 
[x*^") (cui, . . . , cUn)]'", with m > 1 obey the very same dispersion relations as that written for 
m = 1 in Eq. f|T2l) . This implies that the generality of these dispersion relation goes beyond 
not only the distinction between classical and quantum equilibrium system, as discussed in 
Q, [3], but also beyond the distinction between equilibrium and non-equilibrium systems, 
at least when we consider the Axiom A case or adopt the chaotic hypothesis for many 
particles systems. 

The dispersion relations f|TT]) and f|T2l) may be thought of being of doubtful interest from 
an experimental point of view, since on one side we basically can have access to quantities like 



($) (ti^s), which results from a hnear combination of, in general, more than one different 
susceptibility functions (in the sense that they are evaluated at different values of their 
arguments). Moreover, most of the physically relevant nonlinear phenomena are described by 
nonlinear susceptibilities where all or part of the frequency variables are mutually dependent, 
such in the later described case of n*^ order harmonic generation at frequency nuj in the 
presence of a monochromatic modulation function e{t) = exp [— icjo'f] +exp [ic^o^] of frequency 
ujo- We may, therefore, understand that a more flexible theory is needed in order to provide 
the effectively relevant dispersion relations for nonlinear phenomena. 

B. A New Definition of Dispersion Relations 

We take the following point of view. When considering the n^^ order nonlinear process, a 
meaningful dispersion relation involves a line integral in the space of the frequency variables, 
which entails the choice of a one- dimensional space embedded in a n-dimensional space. 
This corresponds to the realistic experimental setting where only the frequency of one of 
the monochromatic fields described in Eq. ([8]) is changed. Since in the nonlinear setting we 
have frequency mixing, changing the frequency of one of the components of the forcing will 

(n) 

change differently each of the terms ($) (^^s); depending on whether none, one or more 
than one arguments of the contributing nonlinear susceptibility functions (see Eq. ffTOl) ) 
are varied. The choice of the parameterization then selects different susceptibilities and so 
refers to different nonlinear processes. Each component j of the straight line in M" can be 
parameterized as follows: 



where the parameter s G M, the vector -u G M" of its coefficients describes the direction of the 
straight line, and the vector uJ G M" determines cJ(0). Since we know that x''"^ (^i? • • • ,^n) 
is holomorphic in the upper complex plane of each variable Ui, 1 < i < n, we have that the 
extension for complex values of s of the function: 



(13) 



X 



VnS + W„) 



oo 



(14) 



/ 



/ 



n 



n 



— oo 



dti . . . dt„G(") {t 1, . . . , t„) exp is ^ Vjtj + i ^ Wjtj 

. i=i i=i 



is holomorphic in the upper complex s plane if all the components of vector v are non- 
negative. This construction has been first proposed in the context of nonlinear optics in 23|. 

T-fpTipp Kv flnnlvincr tVif TitrVimflTph tVipnrpm wp rlfHiipp that for all 1 thf fnllnwincr 



integral relation holds for the susceptibility defined in Eq. ([T 



oo 

1 m 



in[x^-\s)r = P I ^^^^d.', (15) 



which, when the real and imaginary part of the nonlinear susceptibility are considered, 
results into: 

OO 

Re|[x'"'W]n^ip/!=^iMld.'. (16) 



TT / S' — S 



-oo 



i.{[,<...,r}^-ip/^*md.^ ,17, 

— oo 

The condition on the sign of the directional vectors of the straight line in M" implies that only 
one particular class of nonlinear susceptibilities possess the holomorphic properties required 
to obey the dispersion relations f|T6l) . Hence, causality is not a sufficient condition for 
the existence of K-K relations between the real and imaginary part of a general nonlinear 
susceptibility function, if its arguments are mutually dependent. We stress that, instead, 
causality implies that Eq. ( |T2l) holds. 



C. Harmonic Generation 

In order to clarify the results presented in the previous sections, and show how they 
can be used for analyzing actual data, we concentrate on the simplified setting of a single 
monochromatic perturbation field such that e{t) = exp[— Icuq^] + exp[ici;ot]. In this case, at 
each order n, = ±(2j + 1), with tuo, j = 0, . . . , (n — l)/2 if n is odd and = ±2jujQ, 
with j = 0, . . . , n/2 if 77, is even. Note that for even orders there is always a static response. 



which, in the optical literature, is known as optical rectification [15|. If we focus, e.g., on 
the third order of perturbation and consider only the positive frequencies, we have that the 
observable signal at Uq, constituting the first correction to the linear response is: 

{(j)) (u;o) = X^^H-t^o,t^o,t^o) +X^^Ht^o,-t^o,LUo) + X^^H^o,t^o,-t^o); (18) 



whereas the observable signal, responsible for the third harmonic generation is: 

(0)^'^(3^o) = X^'H^o,^o,^o); (19) 



If we change the frequency ujq of the perturbation field and study how the output varies, it 
is clear that for all the three terms comparing on the right hand side of Eq. f|T8|) the vector 

V of the s-parameterization proposed in Eq. (1131) has one negative component, whereas 

V = (1, 1, 1) for the only term responsible for harmonic generation in Eq. f[T^ . This implies 
that, when analyzing the first nonlinear correction to the linear response at frequency uq, 
we cannot expect that K-K relations apply, since poles in the upper complex plane of the 
s = ujq may well be present {2^. In this case, different sig nal processing techniques, such as 



the Maximum Entropy Method, have to be adopted [15|]. Therefore, the condition on the 
sign of V is in this case useful for giving a negative statement, i.e. determining when K-K 
cannot be applied. On the contrary, we are granted that the susceptibility describing the 
third harmonic nonlinear response obeys K-K relation. It is clear that the same applies at 
all orders n, and also it can be easily shown that the only contribution to the observable 
{(l))^''\nuJo) is X^'^K^o, • • • ,t^o)- 

At every order n, we have that x*'"'' {—^i, ■ ■ ■ , — t^n) = {x''"'' (^-^i) • • • ) ^n)}* {{Z}* indicat- 
ing the complex conjugate of Z), because {^)^"'^{t) and e{t) are real. It is is easy to show 
that the following relation holds for all values of m > 1: 



[X^"^ (-^1, • • . , -^n)]™ = { [X^") (^1, • • .,u;^)r} , (20) 
We then derive that at all orders n > 1 and for all m > 1: 

- Trim <^ [x^ > {ujo, Wo) \ =uJoP / duo , ,2 T\ (^1) 



00 



21 ) J (u' -u^) 







which, albeit in a different perspective from what shown in Eq. f[T^ . generalize the linear 
K-K at all orders. Note that, if we consider limj^^^^o of Eq. (122]) in the linear case and assume 
that the limits converge, we obtain the following expression for the linear static response of 
the system: 

Re{[x'"(0)]°} = [Re{x<"(0)}]° = fp 1 iJ^^^^MlpTl, (23) 

'J 


the finiteness of the integral is consistent with the fact that, by symmetry, 
Im I Ty^^) iujn = 0)1™ j = 0, which must be obeyed for all values of m > 1. Note that a 



detailed verification of linear K-K has been performed in the case of Lorenz system [25 1. 
It is somewhat surprising to observe how the qualitative features of the detected (and re- 
constructed) susceptibility are similar to what results from a simple oscillator model: the 
imaginary part has a strong peak for a resonance of system (even if in this case there is 
no deterministic natural frequency for the system), which matches the dispersive structure 
found for the real part of the susceptibility. Another minor spectral feature is observed, and 
again, following the spectroscopic paradigm, a peak in the imaginary part is associated to 
a dispersive structure in the real part. Note also that the Lorenz system is non-Axiom A, 
which suggests that a wide range of applicability for these relations is still to be explored. 
Note that, even if several monochromatic forcings are present, Eqs. fl21l) - fl22l) still apply, 
since no other frequency components are involved. 

If we plug = (1, . . . , 1) and tv = {0, . . . ,0), and redefine s = cjq in Eq. f|T^ . and consider 
the basic properties of the Fourier Transform, we have that the short time behavior of the 
^th Qj.(^Qj. Qj-een function determines the asymptotic behavior of the n*'^ order harmonic 
susceptibility at frequency huq. We perform the following variable change 



J2^k, (24) 



k=l 



assume that G'^"^(ti(ri), . . . , tn{Ti, . . . r,i)) be smooth for all its arguments {tj} in 0, and let (3 
be the smallest sum of exponents of (ti, . . . r„) such that there is a non- vanishing monomial 
M/3(ri, . . . , r„) in the Taylor expansion G^'^Hu (ri), . . . , t„(ri, . . . r„)). We then have that the 
following limit exists and is finite Q, [is], 26 1: 



lim o;o^+"x^"H^o, . . . , ^o) = « G M \ {0}, (25) 



which implies that the asymptotic behavior of ^'■'^■'('^O; • • • ,^o) is at least as fast as uJq"'- 
Moreover, since Re \^x^'^K^o^ ■ ■ ■ ^i^o)} is an even function of ujq and, from Eq. (l25l) . deter- 
mines the asymptotic behaviour (Im {x*^'^^(a;o, . . . , Ci;o)} has a faster asymptotic decrease), 
we derive that j3 + n must be even, so that {3 + n = 27. Therefore, dispersion theory 
provides us with indirect information also about the short time behavior of the Green func- 
tion. Furthermore, the knowledge of the asymptotic behavior allows a further generaliza- 
tion of what presented in (!2T]) - (!22|) . In fact, we have that all the (independent) functions 
,^2pT^(n)^^^^ . . . , ti^o), p = 0, . . . , 7 — 1 are holomorphic in the upper complex plane of ujq and 
obey suitable integrability conditions allowing for writing the following set of generalized 



K-K relations: 



oo „ 

luo'^^Hm { [x^"^ . . . ,a;o)]'"} = P / du',^ 



Re { [x^"^ 



0' 



(26) 



P / duj. 



(27) 



with p = 0, . . . , m7 — 1. Comparing the asymptotic 
obtained by applying the super convergence theorem 
fl27|) . we derive the following set of general sum rules 



jehavior given in Eq. fl2^ with those 



27( 1 to the general K-K relations 



(28) 



'2p+lj. 



m 



0' 



,w^))]"'|dcj' = 0, 0<p<m7-2, 



(29) 



oo 

I W^^-^^Im { [x^") (..^,...,..^)]'"}d.;' 



-a 



'-1 
2' 



p = m7 — 1. 



(30) 



All the moments of the n*'' order harmonic generation susceptibility vanish except that of 
order 27 — 1 of the imaginary part. This latter sum rule creates a conceptual bridge between 
the measurements of the imaginary part of the susceptibility under examination throughout 
the spectrum to the short term behavior of the n*'^ Green function. These results hold for 
all values of m > 1. The generalized K-K relations and sum rules here presented constitute 
a rather extensive set of stringent integral constraints that must be obeyed by experimental 
data and model simulations. These results generalize what obtained for general optical 



systems near equilibrium 



26| and for simple mechanical systems 



Note that both the 



generalized K-K relations (!26l) - (l27|) and the sum rules (!28|) - (!30|) have been verified in detail 
on experimental data in the case of optical processes near equilibrium ^ 



IV. SUMMARY AND CONCLUSIONS 

In this paper we have considered the general response function G*-"^(ti, . . . ,t„) recently 
proposed by Ruelle 0, 4] for describing the impact of small time-dependent forcings to 
the non-equilibrium steady states resulting from Axiom A dynamical systems, which, when 

talfincr intn appnimt tVip pViantip VivnntViPsis Kv riallflvntti anrl CnVipn l\ Isl arp nf crpTipral 



physical interest. At all orders of perturbative expansion, the effect of the forcing on the 
expectation value of a general observable can be expressed in terms of means of quantities 
performed at non-equilibrium steady state. 

Since, at every order of perturbation, the response function is causal, it is possible to 
write a set of Kramers-Kronig relations for the corresponding susceptibility, defined as the 
multivariable Fourier Transform of the response function x^^H^^^ • • • 5 ^n)- These dispersion 
relations are of little applicability because they cannot be used to effectively analyze the 
output signal, which is the change in the expectation observable of the considered observable. 

In practice, it is interesting to consider the case of one or more monochromatic forcings 
and to be in the condition of analyzing what happens when the frequency of one of them is 
changed. Since in the nonlinear setting of order n we have frequency mixing, such frequency 
tuning will affect differently the various frequency components of the observed output signal, 
depending on whether none, one or more than one arguments of the nonlinear susceptibil- 
ity functions responsible for the observed frequency components of the output are varied. 
Therefore, following this approach, the dispersion relation becomes a parameterized line in- 
tegral in the n-dimensional space of frequency variables. K-K relations apply only for special 
forms of parameterizations, which correspond to a specific family of susceptibility functions. 
These results are system-independent and derive strictly from complex analysis. 

Among the phenomena which can be treated using the K-K formalism, we concentrate 
on the 77,*'^ order process by which the system responds at frequency nuo when forced by a 
monochromatic vectorial field with angular frequency uq. Such a process is described by the 
harmonic generation susceptibility ^^"'•'(cl'o, . . . , luq), which is holomorphic in the upper com- 
plex uq plane and obeys K-K relations. For any given system, the asymptotic behavior for 
large frequencies is shown to depend on the short-time response and to be of the form uJq'^^. 
It is then proved that all functions lu'^'p x^'^K^o^ • • • 5 "^o) with p = 0, . . . , 7 — 1 obey K-K re- 
lations, so that more stringent , generalized constraints are established. Furthermore, using 
symmetry arguments and the super convergence theorem on the generalized K-K relations, 
and comparing the results with the asymptotic behavior for large values of uq, new sum rules 
are obtained. We derive that all even moments of the real part and all odd moments of the 
imaginary parts are null, except for the highest converging odd moment of the imaginary 
part of the susceptibility, which is directly related to the short time behavior of the system. 
Furthermore, these results are also extended to the powers [^'^"^(ix'o, . . . ,u;o)]"*, m > 1 of 
the susceptibility, and additional constraints are derived. The obtained generalized K-K 
relations and sum rules can be used to check any experimental data and approximate theory 
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These results generalize and extend what obtained by Ruelle [3|, |J] for Axiom A systems, 
set in a much more general theoretical framework previous findings obtained for near equi- 



libdum optical processes UM and and simple yet prototypical mechan.cal systems near 
equilibrium [18|, and shed light on the generality of the constraints deriving from the prin- 
ciple of causality, which can be used for testing model outputs and experimental data, both 
for equilibrium and non-equilibrium systems. Note that, as discussed in fiol . Q, 1^, basi- 
cally all K-K relations and sum rules can be rephrased, after lengthy but straightforward 
calculations, in terms of absolute value and phase of the susceptibility function, which in 
some cases may be of easier experimental observation. 

It is somewhat surprising, and encouraging in the perspective of the theory here devel- 



oped, to see that the linear susceptibility of the Lorenz system investigated in [25| looks a lot 
like the result of an optical experiment: the peaks of the imaginary part, corresponding to 
the resonances of system (even if in this case there are no deterministic natural frequencies) 
match the dispersive structures found for the real part of the susceptibility. Note that, far 
from being a curiosity, it is throu gh t his approach that the optical constants of most solids 



have been actually computed |29l. l30|. 



In order to clarify and complete the picture, we have shown, in App. |Al that the functions 
derived for non equilibrium steady states are formally equivalent, at all perturbative orders, 
to what obtained with the Kubo formalism for the response of systems close to equilibrium, 
apart from the measure involved in the phase space integration. In the case of near to 
equilibrium system, the measure is the one describing the canonical distribution, whereas 
in the setting analyzed by Ruelle, the SRB measure of the unperturbed flow is involved. 
Therefore, all the results presented in the paper apply, a fortiori, for these equilibrium 
systems. 

The response theory for Axiom A systems can have interesting implications for climate 
studies. In fact, the possibility of defining a response function basically poses the problem of 
climate change is well-defined context, and, when considering the procedures aimed at im- 
proving climate models, justifies rigorously the procedures of tuning and adjusting of the free 
parameters. Furthermore, qualitative differences between different and widespread ensemble 
simulation practices can be interpreted in this context. Moreover, the non-equivalence of free 
and forced fluctuations explains why many attempts of applying the fluctuation-dissipation 
theorem in climate studies have basically failed. Instead, it may be that the general theory 
of Kramers-Kronig relations described in this paper, which, in the case of non-equilibrium 
system, is decoupled form the fluctuation-dissipation theorem, may provide a viable way of 
dp.fininpr a, r.nmnrp.hp.nsivp. splf-r.nnsistpnt thpnrv nf r.limatp r,ha,np"p p.nsiirpd bv thp intpprral 



relations connecting the in-phase and our of phase components of the response of the system 
to external perturbations. This is discussed in some greater detail in App. [Bl 

We conclude with some practical caveats. As well known, it is surely not trivial in 
practical terms to effectively verify the K-K relations and sum rules on experimental or model 
generated data. One general problem is their integral formulation, which requires that data 
are available on a rather extensive spectral range and with a reasonable resolution. This may 
raise issue of computational costs and/or experimental set-up. The extrapolations in K-K 



analysis can be a serious source of errors [30|, ISli- Recently, King 



32l | presented an efficient 



numerical approach to the evaluation of K-K relations, and singly and multiply subtractive 



K- 



^ relations have been proposed in order to relax the limitations caused by finite-range data 



33 



3J] . It should be noted that K-K relations for higher-order susceptibilities are, somewhat 



counter-intuitively, sometimes easier to verify than the linear K-K relations, because they 
have typically a much faster asymptotic decrease. Whereas we have shown that at all 
orders large families of K-K relations hold for the various moments and various powers of 
the susceptibility functions, it should be expected that they do not converge at the same 
rate when data of finite precisions coming from a finite spectral range are used. See the 
discussion in 1^, isl. Furthermore, when considering chaotic systems, further problems in 
signal detection of the system response at specific frequencies are related to the presence 
of a continuous spectrum in the background; this latter issue may become more serious 
when nonlinear processes are examined and the observed monochromatic signal is weaker. 
Nevertheless, along the line of Reick 25|] these problems may result to be manageable. 
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APPENDIX A: RECONCILING KUBO'S AND RUELLE'S GENERAL PERTUR- 
BATIVE RESPONSE FUNCTIONS 



In this appendix we show how to reconcile formally the n^^ order perturbative response 
for general systems characterized by non-equilibrium steady state presented in Eq. ^ with 



the classical results obtained with the Kubo formalism jl| for the response for systems close 
to equilibrium. Therefore, all the results presented in the paper apply, a fortiori, for these 
equilibrium systems. 

We consider a system of N degrees of freedom described by the canonical coordinates 
q = (gi, . . . , g^r) and p = (pi, . . . ,p]\f) and evolving under the action of the Hamiltonian 
operator H{q,p) = HQ{q,p) + h{q,p,t), composed of the unperturbed Hamiltonian HQ{q,p) 
plus the time dependent perturbation (weak) Hamiltonian expressed in the form h{q,p,t) = 
—e{t)B{q,p) j^. The evolution equation of the system can then be written as: 

X = F{x) + e{t)X{x) (Al) 

where x = {q,p)', F{x) = QVH{x), X{x) = —QVB{x), with Q indicating the symplectic 
matrix. We assume that, if the perturbation is set to 0, the expectation value of any 
observable $ can be expressed as the following: 

($)o = J dxpo{x)<!>{x) = J po{dx)<^{x) (A2) 

where integration is performed in the phase space of the system, and the canonical distri- 
bution, which is absolutely continuous with respect to the Lebesgue measure of the phase 
space, is defined as usual as: 

Po[dx) = po{x)dx = -^r— ——-——dx = J. — — dx. A3 

j dlexp [-Ho{x)/kT\ J po{dx) 

Following the perturbative approach introduced by Kubo we have that, for small per- 
turbations, the expectation value of $ at time t can be written as: 

oo 

(<^')W = (<^')o + $^($)("ni) (A4) 

n=l 

where the terms under summation describe the non-equilibrium properties - for a system 
which is close to equilibrium - at all orders of perturbation; in particular the n = 1 terms 
provides information of the linear response of the system. The perturbative terms can be 



expressed as follows 



oo oo oo 



($)W(t)= J J ... J daida2...da„, X 

— oo — oo — oo 

X . . . [B{x{<Jn - ^2)), . . . [B{x{<Jn " ^i)), $(a;((T„,))]] . . .])o = 

00 00 00 

= j J ... J daida2...danG^''\ai,...,an)e{t-ai)e{t-a2)...e{t-an), (A5) 



-00 —00 —00 



where the time evolution of the observables B and $ is due to the unperturbed Hamiltonian 
Hq. The two main are that the non-equilibrium response is expressed as a convolution 
integral where the Kernel, which is the n*^ order Green function G^'^\ai, . . . , cr„) is causal. 

Note that the Kernel operator in the quantum case, where we deal with N-particles 
Hilbert space and observables are replaced by operators, is formally obtained by simply 
substituting each Poisson brackets [•, •] with l/(i^) times the commutator {•,•}, and by 
redefining the expectation value at equilibrium of a generic operator P as follows: 

/p\ Ea(Q|-P|Q)exp [-Eg/kT] 
E^exp [-Eb/kT\ 

where \a) is the eigenstate with eigenvalue Ea of the Hamiltonian operator Hq. 
Since the following trivial identity holds: 

[B{x),.]=X{x)V{*) = A{*) (A7) 

and since, by definition, the evolution of any observable A driven by the unperturbed Hamil- 
tonian Hq can be formally represented as follows: 

A{x{t)) = exp{iTL)A{x) = U{t)A{x), (A8) 

where iLA{x) = [A{x), Ho{x)], the n*'* order Green function can be formally written in the 
following compact and form: 



G("HcTi,...,a„ 



J po(dx)AH(a„ - an-i) . . . AH(cr2 - (Ti)AH((Ti)<I'(x). (A9) 



which is fully equivalent to the formula shown in Eq. ([5]), provided that the measure de- 
scribing the equilibrium canonical distribution is substituted with the general SRB measure. 



APPENDIX B: RESPONSE THEORY FOR NON-EQUILIBRIUM STEADY 
STATES AND CLIMATE RESEARCH 



When adopting the chaotic hypothesis, the possibihty of defining a response function of 
a perturbed non-equihbrium steady state and its actual properties seem to have very inter- 
esting impacts in chmate studies. On one side, this creates a context where the problem of 
climate change is well-posed at mathematical level and where, when considering the proce- 
dures aimed at improving climate models, the tuning and adjustment of the free parameters 
- at least locally - may be considered as a well-defined operation devoid of catastrophic 
impacts on the statistical properties of the system. On the other hand, straightforward ap- 



plications of fiuctuation-dissipation theorem [35|, |36|, o r the idea that climate change signal 



37| seem inadequate, as discussed in [38|. 



project on the natural modes of climate variability 
Instead, it seems that the theory of Kramers-Kronig relations described in this paper may 
provide a viable way of defining a comprehensive self-consistent theory of climate change, 
ensured by the integral relations connecting the in-phase and our of phase components of 
the response of the system to external perturbations. As an example, we may interpret 
Eq. (123|) as the fact that the static response function - measuring climate sensitivity - can 
be related to the out-of-phase response to same forcing at all frequencies, at least in first 
approximation. 

The concepts behind the Ruelle response theory also clarify the meaning of some com- 
mon ensemble simulation practices, which are widely adopted by the climate modelling 
community with the goal of estimating the uncertainty on the statistical properties of the 



model outputs, when a specific set of observables is considered 
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4l|. Three different 



strategies, which are nevertheless more and more hybridized, can be pointed out: 

• Each simulation is performed with the same climate model, but starting from slightly 
different initial state; 

• Each simulation is performed with the same climate model, but with slightly different 
values of some key uncertain parameters characterizing the global climatic properties, 

• Each simulation is performed with a different climate model [multi-model ensemble). 

Under the chaotic hypothesis, the first procedure seems useful, since a more detailed explo- 
ration of the phase space of the system, with a better sampling - on a finite time - of the 
attractor of the model. The significance of the second procedure seem to be reinforced by the 
response theory for non equilibrium steady states, because in this case the variously tuned 



models basically explore parameterically deformed ergodic measures, and the macroscopic 
sensitivity of the model is thus explored. As for the third procedure, whereas it surely al- 
lows for climate model intercomparison, aggregating information from from rather different 
attractors seems ill-defined. 
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